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Abstract.  The  lower  bounds  on  the  additive  complexity  of  a  bilinear  problem  are  expressed  in 
terms  of  the  rank  of  the  problem  and  also  as  a  minimum  number  of  elementary  steps  for  the 
transformation  of  the  identity  matrix  into  a  strongly  regular  one. 
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As  is  well  known,  the  basic  part  of  the  theory  of  algebraic  computational  complexity  had  been 
shaped  by  1966;  cf.  [1,2,3].  In  particular,  until  very  recently  the  lower  bounds  on  the  additive 
complexity,  C(±),  of  intensively  studied  linear  and  bilinear  arithmetic  algorithms  for  arithmetic 
computational  problems  (such  as  DFT  and  matrix  and  polynomial  multiplication,  MM,  PM)  have 
relied  on  the  active  operation- basic  substitution  argument  due  to  [1,2,3];  cf.  also  [4].  Consequently, 
those  bounds  have  not  exceeded  D,  the  dimension  of  the  problems  that  is  the  total  number  of 
input  variables  and  outputs.  In  the  present  paper  we  consider  another  algebraic  approach  that 
generalizes  the  ingenious  method  of  [5].  This  enables  us  to  reduce  the  problem  to  estimating  the 
ranks  of  multidimensional  tensors  that  we  associate  with  the  given  computational  problems.  The 
successful  solution  of  a  similar  problem  in  [6]  gives  some  ground  for  optimism  in  the  attempts  to 
establish  nonlinear  lower  bounds  on  C(±)  along  this  line.  We  also  present  another  direction  to 
attack  the  problem  which  reduces  it  to  the  study  of  a  strong  regularity  of  matrices;  see  Definition 
2  and  the  Theorem  below. 

Notation.  I,  J ,  K  are  positive  integers^  vh  =  (V)*,  Hjt  —  are  the  entry  h  of  a  vector 
V_  and  the  entry  (j,  s)  of  a  matrix  n,  respectively.  F  is  a  field  of  constants.  X.  is  a  vector  of 
indeterminates,  x »,  t  =  0,1,  —  1.  L(X.F)  is  the  set  of  all  homogeneous  linear  forms  of 

xo,  with  the  coefficients  from  F. 

Any  K  X  J  matrix,  n  =  p(X)  with  the  entries  from  L(X,  F)  defines  a  bilinear  arithmetic 
problem  that  is  the  set  of  bilinear  forms  (bfcQC,  Y)}  whose  Y-coefficients  form  the  matrix  u[X)\ 
cf.  [7,8].  A  bilinear  arithmetic  algorithm,  A,  that  solves  such  a  problem  can  be  represented  as  a 
chain  of  matrices  (p(0),p(l),  . . .  ,p(C))  (cf.  [5,7,8])  such  that  p(0)  is  the  J  X  J  identity  matrix,  p 
is  a  submatrix  of  p(C),  each  n(q)  is  a  /  X  (/  -f  q)  matrix  such  that 

/“(<7  +  1)  =  (#*(«)  I  Z(?  +  1))  for?  =  0,1 . C  —  1 ,  (1) 

where  for  all  j  either 

{V[q  +  1));  =  L{q){n[q)).t  for  some  s  =  s(?)  <  q  +  J  (2) 

or 

{V{q  +  1)),  =  (rfq))JP  +  *(m(?))„ 

for  some  p  =  p(?)  <  q+  J ,  a  =  s(?)  <  q  / .  (3) 

In  (3),  6  =  1  or  6  =  —  1.  In  (2)  either  L(?)  €  F  or  otherwise:  L(?)  €  L[X_>F )  and  (p(?))JS  6  F 
for  8  =  8 (?)  and  for  all  j.  F  •  Cx(±)  designates  the  number  of  ?  such  that  (3)  holds. 

Definition  1  (cf.  [9,10]).  Given  PQL),  a  homogeneous  polynomial  in  x<>,  •  •  • ,  x/— i  of  degree  d,  then 
r(P(2f)),  the  rank  of  P{X),  is  the  minimum  integer  r  >  0  such  that 

r  d 

■  E  n  *  V(£)  £WL,F). 
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Let  D  =  D(MQO)  designate  the  set  of  all  minors  of  a  matrix  M(X)  with  the  entries  from 
L(X_,  F),  r( M)  =  maxmg d  r(m).  (We  say  that  r[M)  is  the  rank  of  the  bilinear  problem  associated 
with  the  matrix  M(X)-)  Then  the  next  lemma  is  easily  verified. 

Lemma  1.  Equation  (2)  implies  that  r(/x(q-J-l))  =  r(p(q)),  Equation  (3)  implies  that  r(^(q-f-l))  < 
2r(M(q)). 

Corollary.  Given  a  bilinear  algorithm,  A  (cf.  (l)-(3)),  for  the  bilinear  problem  defined  by  a  matrix 
M  =  M(X)»  then  CA{±)  >  log2  r[p). 

Hence,  logr(p)  =  fi(nlogn)  for  the  general  n  X  n  Toeplitz  matrix  [J  =  K  —  n,  pjk  — 
ij—fc+n— 1 1  j>  k  =  0, 1,  . . . ,  n  —  1)  would  imply  nonlinear  lower  bounds  on  the  complexity  of  PM 
and  DFT. 

Remark.  If  P„(X)  =  -Pn(Xi>  •  •  *  >Xn)  is  an  n-linear  form  in  n  vectors  of  indeterminates, 
Xi,  •  •  •  ,Xn>  i'i1611  polylinear  rank,  H(P„(X))»  can  be  defined  as  the  minimum  integer  R  such 
that 

R  n 

Pn(X)  =  £  II  MXJ€L(Xk,P). 

8=- 1 

As  is  obvious,  i?(P»(X))  >  r(Pn(X))*  P(Pz(Xi  >  X2))  equals  the  “usual”  rank  of  the  matrix 
of  coefficients  of  the  bilinear  form  P?(Xt.X2).  i?(P3(Xi,X2.X3))  equals  the  multiplicative 
complexity  of  the  three  bilinear  computational  problems  associated  with  P3(X1,X2,  X3),  (cf. 
[11,12]).  If  /x(X)  is  an  n  X  n  matrix  with  row- vectors  of  indeterminates  Xi»X2i  •••,X„>  then 
log2  R( per  p(X))  <  n  (cf.  [13]).  Because  of  the  latter  estimate  the  inequality  log2  r(M)  >  n  seems 
to  be  either  false  or  very  hard  to  prove  even  in  the  case  of  a  general  n  X  n  matrix  p. 

Despite  the  latter  remark,  we  hope  that  the  reader  will  be  challenged  to  look  for  a  better 
modification  of  the  above  approach  and  for  new  methods  for  establishing  lower  bounds  on  C(±). 
Here  is  another  example  of  natural  approaches  to  this  problem. 

Definition  2.  A  matrix  is  strongly  regular  if  it  contains  no  singular  submatrix.  Given  a  J  X  s 
matrix  p  and  a  field  F  then  the  elementary  additive  augmentation  step  consists  of  adding  a  new 
column-vector  to  p  which  is  a  linear  combination  with  the  coefficients  from  F  of  two  columns  of 
p.  C±{J),  the  regularization  number  of  order  J  is  the  minimum  number  of  elementary  additive 
augmentation  steps  required  to  transform  the  J  X  J  identity  matrix  into  a  matrix  that  has  a- 
strongly  regular  J  X  J  submatrix. 

Theorem.  Let  Y  be  the  J -dimensional  vector  of  indeterminates,  p  be  a  J  X  J  matrix  over  F 
that  has  a  strongly  regular  s  X  s  submatrix.  Then  the  additive  complexity  of  the  evaluation  of 
p  Y  is  at  least  C±(s). 

In  particular,  the  general  Toeplitz  matrices  are  strongly  regular.  Hence  any  nonlinear  lower 
bound  on  CLj^s)  would  imply  a  nonlinear  lower  bound  on  C(±)  in  the  cases  of  PM  and  DFT. 

I  wish  to  thank  Evelyn  Laurent,  IAS,  and  Phyllis  Winkler,  Stanford  University,  for  typing  this 
paper. 
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